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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a method for 
converting a two-dimensional video image into a 
three-dimensional video image that can suppress a 
converted image from being distorted in the case that 
a distance scale conversion is used to convert a 
depth estimate amount into a parallax amount. 
SOLUTION: In the case that a maximum value of a 
phase difference within adjacent parallax calculation 
areas is at the outside of a predetermined distortion 
permissible range, a dynamic range to bring the 
phase difference within the parallax calculation area 
into the distortion permissible range is searched, 
distance scale conversion using the retrieved 
dynamic range is applied to each depth estimate 
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value to obtain a tentative target phase amount for each parallax calculation area. 
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* NOTICES * 




JPO and NCI PI are not ire sponsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] Based on a two-dimensional video signal, the image characteristic quantity about the 
distance of an image is extracted to two or more parallax calculation fields of each set up in 1 screen. 
As opposed to the 1st step and each depth estimate which generate the depth estimate for every 
parallax calculation field based on the extracted image characteristic quantity By performing 
distance scale conversion using the dynamic range specified with the predetermined amount of the 
maximum elutriation, and the predetermined amount of the maximum depth It is based on the 2nd 
step and the temporary amount of target phases for every parallax calculation field which calculate 
the temporary amount of target phases for every parallax calculation field. The 3rd step which 
calculates the maximum of the phase contrast between adjoining parallax calculation fields, The 4th 
step which judges whether it is in the distortion tolerance where the maximum of the phase contrast 
between adjoining parallax calculation fields was defined beforehand, When the maximum of the 
phase contrast between adjoining parallax calculation fields is outside the distortion tolerance 
appointed beforehand Look for a dynamic range with which the phase contrast between the above- 
mentioned parallax calculation fields becomes in distortion tolerance, and each depth estimate is 
received. How to change into a 3D scenography the two-dimensional image equipped with the 5th 
step which shifts to the 3rd step after performing distance scale conversion using the dynamic range 
for which it looked and calculating the temporary amount of target phases for every parallax 
calculation field. 

[Claim 2] How to change into a 3D scenography the two-dimensional image according to claim 1 
characterized by performing distance scale conversion using the dynamic range after amendment to 
each depth estimate after the ratio of the amount of the maximum elutriation and the amount of the 
maximum depth which are specified in the 5th step of the above by the dynamic range for which it 
looked amends a dynamic range so that it may become the ratio defined beforehand. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the approach of changing a two-dimensional image 

into a 3D scenography. 

[0002] 

[Description of the Prior Art] As an approach of changing a two-dimensional image into a 3D 
scenography, these people divide one screen into two or more fields, presume the depth of each field 
from the image information obtained from each field, and composition, and have already developed 
the technique (henceforth the CID method) of generating binocular parallax by shifting each pixel in 
a screen based on this presumed depth (refer to JP,1 1-8862,A and JP,1 1-98530,A). 
[0003] Moreover, these people are also developing the CED method which improved the already 
developed CID method further. 

[0004] Drawing 1 shows the control procedure of the CID method after amelioration (it is not well- 
known). 

[0005] First, one screen is divided into two or more fields, and they are a RF, brightness contrast, 
and a color (B-Y and R-Y component) from each field. Information is acquired (step 1). And the 
depth estimate of each field presumed from such information and composition is calculated (step 2). 
Since distortion is conspicuous in an resolution picture when the calculated depth estimate is only 
changed into a shift amount, distortion oppression processing is performed (step 3). Distance scale 
conversion is performed to the depth estimate after distortion oppression processing (step 4). 
[0006] Distortion oppression processing is explained. By the CID method, 2D image is transformed 
and a right-and-left image is generated. Since it will become an unnatural image if this deformation 
becomes large too much, it is controlling by the CID method so that the difference of the amount of 
phases between adjoining fields becomes below distortion tolerance h_supp_lev [Pixel] of the 
resolution picture beforehand defined by the user. That is, they are Mfront and Mrear about the 
presumed depth. The difference of the amount of phases of the field which adjoins from the amount 
of phases of each field for which it asked by assigning in between is searched for. Maximum of this 
difference is made into h_dv_max [pixel], and it is hdvmax. They are Mfront and Mrear until it 
satisfies the degree type 1, when exceeding distortion tolerance h_supp_lev [pixel]. 0 [pixel] It is 
made small in the direction brought close. 
[0007] 

J Equation 1] 
_dv _jnax £ h_supp_lev 

[0008] Therefore, h_dv_max h_supp_lev When large, as it is shown in drawing on the right-hand 
side of drawing 2 , it extends far back with the amount front of elutriation phases of a conversion 
image [Pixel], and it is the amount rear of phases [Pixel]. The amount Mfront of maximum 
elutriation phases which the user defined beforehand by the linearity operation of the degree type 2 
[Pixel] It is made smaller than the amount Mrear of maximum back ball phases [Pixel].. 
[0009] 
[Equation 2] 
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front = M front* h _jupp _Jev ^^jdv _jnax 

forh_dv _jnax> h_supp_lev 
rear = Mr ear* h _jupp_lev / h_dv _jnax 

for h_fh>_?nax > h_?upp_lev 

[0010] On the contrary, h_dv_max h_supp_lev When small, since the distortion of an resolution 
picture is in tolerance, as shown in the chart on the left of drawing 2 , the degree type 3 is realized. 
[0011] 
[Equation 3] 

front = Affront for h_dv _?nax £ h_jupp_lev 
rear = Mr ear for h_dtvjnax h^uppjev 

[0012] That is, h_dv_max h_supp_lev When small, it is dynamic range dv_range (=front rear) of the 
phase of a conversion image. Dynamic range Mdv_range of the phase which the user defined 
beforehand (=Mfront Mrear) It becomes equal. 

[0013] In addition, the distortion oppression processing which oppresses this dynamic range in the 
system is h_supp_lev in order to mitigate a CPU load. Although carried out by transposing to the 
unit of the presumed depth, it explained using the system of units of the pixel after [ expedient ] 
explaining here. 

[0014] The distance scale conversion approach is explained. 

[0015] On 2 eye type solid display, it has a relation with nonlinear amount W of parallax and its 

fusion location (distance from the tubular surface which looks actual) Yp of corresponding points of 

the image for right eyes (R image), and the image for left eyes (L image). 

[0016] That is, when R image and L image which have parallax W [mm] on a display side are 

observed from the location distance K [mm] Distant from the tubular surface, the distance Yp to the 

fusion location from a tubular surface [mm] is expressed with the degree type 4. 

[0017] 

[Equation 4] 
Yp = KW /(W-2E) 

[0018] In the above-mentioned formula 4, each variable expresses the following values. 
K : distance to the observer from a display tube side [mm] E : One half between eyes Die length 
[mm] W : The amount of parallax of the corresponding points of the image for left eyes on a display 
side, and the image for right eyes [mm] Yp: Distance [mm] [0019] from a tubular surface to a fusion 
location K= 1000mm and 2E=65mm If it carries out and the above-mentioned formula 4 is expressed 
with a graph, it will become like drawing 3 . 

[0020] Drawing 3 shows producing a spatial distortion only by transposing depth estimate to the unit 

of a pixel in linearity at the image which carries out the fusion. So, by the distance scale technique, 

depth estimate is changed into the unit of a pixel in consideration of space distortion. The technique 

of changing depth estimate into the unit (the amount of parallax) of a pixel in linearity is called pixel 

scale conversion, and the technique of changing depth estimate into the unit (the amount of parallax) 

of a pixel in consideration of a fusion location is called distance scale conversion. 

[0021] Hereafter, the distance scale conversion technique is explained briefly. 

[0022] It is U [mm] about width of face of 1 pixel on now and a display. Parallax W is expressed 

with the degree type 5, supposing it carries out and the parallax W for alpha pixel has corresponding 

points. 

[0023] 

JEquation 5] 

[0024] By substituting the above-mentioned formula 5 for the above-mentioned formula 4, as shown 

in the degree type 6, the relation between a pixel and a fusion location can be found. 

[0025] 

[Equation 6] 

Yp = KaU /(aU -2E) 
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[0026] Moreover, the top type 6 is transformed and the degree type 7 is obtained. 

[0027] 

[Equation 7] 

a =2E*Yp/((Yp-K)U} 

[0028] By perfect distance scale conversion, they are amount Ymaxof maximum elutriation 1 from a 
tubular surface, and amount Yminof maximum back balls 1 from a tubular surface. If it specifies, the 
depth Yp which corresponds if the depth estimate depth (it has the value of 0-100) is decided can be 
obtained by the simple scale conversion expressed with the degree type 8. 
[0029] 
[Equation 8] 

Yp^Ymax'-Ymin' )xdepth/10O 

[0030] And the amount alpha of parallax corresponding to Yp is calculated by the above 7. Thereby, 
in consideration of space distortion, depth estimate is convertible for the unit of a pixel. 
[0031] It sets to perfect distance scale conversion, and is 256 steps of amount translation table of 
parallax W". When using, as it is shown in drawing 4 , it is Ymax' - Ymin' first. Between is equally 
divided into 256 and it asks for amount translation table of parallax W" [pixel] which corresponded 
for every depth value Yp based on the above-mentioned formula 7. 

[0032] In this case, W M [255] becomes the amount of parallax corresponding to Ymax', and W" [0] is 
Ymin'. It becomes the corresponding amount of parallax. And depth estimate depth If decided, the 
corresponding amount alpha of parallax can be found from the degree type 9. 
[0033] 
[Equation 9] 

a=W"[Uv] 

[0034] Here, it is lev. The number of stages on the amount translation table of parallax is expressed, 

and it is given by the degree type 10. 

[0035] 

[Equation 10] 

lev =255* depth/ 100 

[0036] So far, although the perfect distance scale conversion technique in 2D / 3D conversion was 
described, there are two problems shown below in this technique. 

[0037] (1) If amount Ymaxof maximum elutriation , is enlarged to the place where depth Yp is 
saturated, set into a part with the depth value near Ymax 1 , and it is distortion (distortion by R image 
and the L image itself) by the resolution picture itself. It becomes large. 

[0038] (2) When it is going to take the large dynamic range of depth rendering space, it is amount 
Yminof maximum back balls 1 . It is made small, and since it does not spread, the field of which it 
jumps out before a tubular surface decreases extremely. 

[0039] In order to avoid the above-mentioned problem, it is necessary to use and change only the 
field which has depth and the amount of parallax in proportionality to some extent. However, then it 
becomes almost the same as pixel scale conversion, and is hard to say that perfect distance scale 
conversion is already useful on the relation which performs complicated processing. 
[0040] Then, what was devised is the polygonal-line distance scale conversion introduced to a 
degree. As polygonal-line distance scale conversion shows to drawing 5 , it is the elutriation 
quantitative ratio C [%]. It introduces, 255*C/100, etc. carry out the part of Ymax'-O, and it is 0 - 
Ymin*. 255 It asks for the amount translation table of parallax by carrying out {(1-C) /100} division 
into equal parts. 

[0041] That is, distortion by the resolution picture in the part which changes the amount of 
elutriation before a tubular surface, and serves as the maximum elutriation by controlling the 
elutriation quantitative ratio C itself can be suppressed. In addition, in polygonal-line distance scale 
conversion, the formula corresponding to the above-mentioned formula 8 turns into the degree type 
11. 

[0042] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 5/13/2005 



JP,2001-298753,A [DETAILED DESCRIPTION] 



Page 4 of 7 



[Equation 11] 

Yp=Ymax'xfdepth-(100-C)f/C for depth > (100 -C) 

Yp = {-Ymin ' x depth / (100 - C)} +2Mr' for depth < C 

[0043] Moreover, amount translation table of parallax W" The formula corresponding to the above- 
mentioned formula 10 showing a number of stages turns into the degree type 12. 
[0044] 

[Equation 12] 

lev =(255 - Dlev) x {depth (100 - C)}/ C+ Dlev for depth * (100- C) 
lev = Dlevxdepth/(100-C) for depth < (100 -C) 

[0045] Here, Dlev is defined by the degree type 13 and expresses the number of stages on the 

amount translation table of parallax corresponding to a tubular surface. 

[0046] 

[Equation 13] 

Diet « (100 -C)x255/10O 

[0047] In the back, a respectively spatial distortion comes out of polygonal-line distance scale 
conversion a front [ tubular surface ] from a tubular surface. Conversely, if it says, a spatial 
distortion will come out in a tubular surface. A distortion more spatial than the language which 
obtained this from many viewers "how for it to be visible after tubing presence is different when 3- 
dimensional scenography is seen" is based on the assumption of becoming the most 
incomprehensible near the tubular surface. 

[0048] In addition, the value currently used actually is Ymax', Ymin 1 , and C so that the inclination 
(step size) of the amount translation table of depth parallax after tubing presence may not be greatly 
different. It has determined. 

[0049] By the way, although the distortion oppression processing using the linearity operation 
mentioned above is effective in pixel scale conversion, it cannot be said to be an effective means to 
distance scale conversion. This is depth Yp and the amount W of parallax by distance scale 
conversion, as shown in drawing 6 . [pixel] It is nonlinear and is because depth estimate has the same 
value, for example, the property in which the amounts of parallax differ greatly before and behind a 
tubular surface also in "1." In addition, this inclination becomes remarkable in a big screen display. 
In the polygonal-line distance scale which is the advanced type of a perfect distance scale, the 
elutriation quantitative ratio C is introduced also in the semantics which eases this property. 
[0050] However, maximum h_dv_max [pixel] of the phase contrast between adjoining fields cannot 
be thoroughly stopped for the elutriation quantitative ratio C in distortion tolerance h_supp_lev 
[pixel] on a controllable polygonal-line distance scale (the principle of the distortion oppression in a 
pixel scale is faithfully unrealizable). In order to realize the principle of this distortion oppression, it 
is necessary to perform distortion oppression processing after distance scale conversion. 
[0051] 

[Problem(s) to be Solved by the Invention] This invention aims at offering the approach of changing 
into a 3D scenography the two-dimensional image which can press down distortion of an resolution 
picture, when changing depth estimate into the amount of parallax using distance scale conversion. 
[0052] 

[Means for Solving the Problem] The approach of changing the two-dimensional image by this 
invention into a 3D scenography Based on a two-dimensional video signal, the image characteristic 
quantity about the distance of an image is extracted to two or more parallax calculation fields of each 
set up in 1 screen. As opposed to the 1st step and each depth estimate which generate the depth 
estimate for every parallax calculation field based on the extracted image characteristic quantity By 
performing distance scale conversion using the dynamic range specified with the predetermined 
amount of the maximum elutriation, and the predetermined amount of the maximum depth It is based 
on the 2nd step and the temporary amount of target phases for every parallax calculation field which 
calculate the temporary amount of target phases for every parallax calculation field. The 3rd step 
which calculates the maximum of the phase contrast between adjoining parallax calculation fields, 
The 4th step which judges whether it is in the distortion tolerance where the maximum of the phase 
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contrast between adjoining parallax calculation fields was defined beforehand, and when the 
maximum of the phase contrast between adjoining parallax calculation fields is outside the distortion 
tolerance appointed beforehand Look for a dynamic range with which the phase contrast between the 
above-mentioned parallax calculation fields becomes in distortion tolerance, and each depth estimate 
is received. After performing distance scale conversion using the dynamic range for which it looked 
and calculating the temporary amount of target phases for every parallax calculation field, it is 
characterized by having the 5th step which shifts to the 3rd step. Here, distance scale conversion 
means the technique of changing depth estimate into the unit (the amount of parallax) of a pixel in 
consideration of a fusion location. On the other hand, the technique of changing depth estimate into 
the unit (the amount of parallax) of a pixel in linearity is called pixel scale conversion. 
[0053] In the 5th step of the above, after the ratio of the amount of the maximum elutriation and the 
amount of the maximum depth which are specified by the dynamic range for which it looked amends 
a dynamic range so that it may become the ratio defined beforehand, it may be made to perform 
distance scale conversion using the dynamic range after amendment to each depth estimate. 
[0054] 

[Embodiment of the Invention] Hereafter, the gestalt of implementation of this invention is explained 
with reference to drawing 7 - drawing 10 . 

[0055] Drawing 7 shows the control procedure of the CID method by the gestalt of implementation 
of this invention. 

[0056] First, one screen is divided into two or more fields, and they are a RF, brightness contrast, 
and a color (B-Y and R-Y component) from each field. Information is acquired (step 11). And the 
depth estimate of each field presumed from such information and composition is calculated (step 
12). The amount of target phases is obtained by performing distance scale conversion and distortion 
oppression processing to the calculated depth estimate (step 13). 

[0057] Drawing 8 shows the distance scale conversion of step 13 of drawing 7 , and the detail of 
distortion oppression processing. 

[0058] First, Mfront and Mrear Distance scale conversion is performed with the dynamic range 
specified, and the temporary amount of target phases is obtained (steps 21 and 22). It is based on the 
obtained temporary amount of target phases, and is maximum h_dv_max of the phase contrast 
between adjoining fields, [pixel] It computes (step 23). 

[0059] maximum h_dv_max of the phase contrast between adjoining fields [pixel] Distortion 
tolerance h_supp_lev [pixel] it is — a ****** is judged (step 24). In being in tolerance, let the 
temporary amount of target phases be a true target phase (step 27). 

[0060] When the maximum of the phase contrast between adjoining fields is outside distortion 
tolerance, the maximum of the phase contrast concerned is h_supp_lev. They are Mfront and Mrear 
until it becomes below. Optimal front and a rear value are acquired by making small the dynamic 
range specified gradually (step 25). Hereafter, processing of step 25 is carried out to sequential- 
search processing for convenience. About the detail of sequential-search processing, it mentions 
later. 

[0061] front calculated by sequential-search processing it becomes the distance ratio specified by 
[ distance ratio with rear ] a user — as — front the step 22 after changing rear (step 26) — return — 
distance scale conversion is performed further. 

[0062] Maximum h_dv_max [pixel] of the phase contrast between adjoining fields is processing of 
steps 22, 23, 24, 25, and 26 Distortion tolerance h_supp_lev [pixel] The final amount of target 
phases is repeatedly obtained until it comes inside. In addition, whenever a dynamic range changes 
in this way, distance scale conversion is performed for realizing to accuracy the principle of the 
distance scale of making an observer perceive the 3 -dimensional scenography which was not 
influenced by the spatial distortion of a solid display, but followed depth estimate. 
[0063] Next, sequential-search processing is explained. 

[0064] With a distance scale with nonlinear depth estimate and amount of phases, it is front. In order 
to enlarge the dynamic range specified with a rear value, the decision of a range is made by 
sequential-search processing. 

[0065] It is amount translation table of parallax W" which it was possible even if calculation of the 
amount of parallax used the amount transformation of depth parallax (formula 1 1) in sequential- 
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search processing, but was beforehand computed as shown below. To use is more efficient. About 
this approach, it is 0-100. It is surface_depth (= 100-C) about the depth estimate of tubular surface 
level when depth estimate is standardized in between. It explains by carrying out. 
[0066] front Amount translation table of parallax W" corresponding to a value and a rear value 
When the upper number of stages is set to Max_lev (= 255 - Dlev) and Min_lev (=Dlev -0), 
respectively, it is a certain depth estimate v_depth. Number of stages lev of the amount translation 
table of parallax It is expressed with the degree type 4. 
[0067] 

[Equation 14] 

lev =(v_depth - surface _depih)* (Maxjev - Dlev)/ (100 - surface _dcpih) + Dlev 

for vjdepth > surface _depth 
lev~(v_depth-ldmjev )* (Dlev -0)/ (surface _depth-MinJev) 

for v_depth < surface _jiepth 

lev — Dlev Jar vjdepth « surface _depth 

[0068] lev The corresponding amount phase of phases Amount translation table of parallax W" Since 

it can be found in a meaning, it can express with the degree type 15. 

[0069] 

[Equation 15] 
phase = W (lev) 

[0070] The phase contrast of two fields which serve as max of the phase contrast between adjoining 
fields in sequential-search processing is h_supp_lev. front which becomes below About a value and 
a rear value, it is Max_lev. Min_lev It can be made to be able to change gradually and can be found 
by things. 

[0071] It responds to the relation of the amount of phases which two fields where the phase contrast 
between adjoining fields serves as max have in sequential-search processing so that clearly from the 
above-mentioned formula 14, and is optimal front. The retrieval approach of a value and a rear value 
becomes the following three kinds. 

[0072] The 1st case: It is front when both car fields have the amount of phases before a tubular 
surface. A value is brought close to 0 and it goes. (Max_lev is brought close to Dlev) . 
[0073] The 2nd case: When both car fields have the back amount of phases from a tubular surface, 
bring a rear value close to 0 and go. (Min_lev is brought close to Dlev) . 

[0074] The 3rd case: When [ both ] one field has the amount of phases before a tubular surface and 
another field has the back amount of phases from a tubular surface, bring front and a rear value close 
to 0, and go (Max lev and Min lev are brought close to Dlev). 

[0075] It is Max_lev so that the relation of the degree type 16 may be held so that the distance ratio 
which the user specified beforehand at the time of sequential-search processing may be held in the 
case of the 3rd case that is,. Min_lev It brings close to Dlev. 
[0076] 

[Equation 16] 

(255 - Dlev): Dlev » (Max Jev-Dlev) : (DUv-MmJev) 

[0077] The above-mentioned formula 16 is synonymous with processing of step 26 of drawing 8 . In 
the 1st case and the 2nd case, in order to reduce the amount of operations, modification processing of 
distance ratio is not performed at the time of sequential-search processing, but step 26 of drawing 8 
performs. 

[0078] In a distance scale, the technique of this distance ratio maintenance is introduced for holding 
the depth relation before and behind a tubular surface, even if a dynamic range changes. As shown in 
drawing 9 , when specifically decreasing the distance before a tubular surface 20% in the 1st case, 
from the tubular surface, a back distance is also decreased 20% and the relation after tubing presence 
is maintained. 

[0079] If this distance ratio maintenance is performed on the amount translation table of parallax, the 
relation of the elutriation quantitative ratio C is also maintainable. A conversion image without sense 
of incongruity can be shown to an observer with the inclination which recognizes space with relative 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 5/13/2005 



JP,2001-298753,A [DETAILED DESCRIPTION] 



Page 7 of 7 



depth by this. 

[0080] However, it may be regarded as an image with it better [ to open the whole dynamic range 
depending on the property of an observer's eyes ]. In such a case, distance ratio maintenance is not 
performed in the 1st case and the 2nd case, but only quantitative ratio maintenance is performed. 
[0081] Drawing 10 shows the case where polygonal-line distance scale conversion of only 
quantitative ratio maintenance is performed, and the case where processing for distance ratio 
maintenance is performed further. In the polygonal-line distance scale conversion of only 
quantitative ratio maintenance, a response of depth estimate and the amount translation table of 
parallax is taken by separate range conversion bordering on the depth estimate of a tubular surface. 
In addition, when distance ratio maintenance is carried out, the amount translation table of parallax 
of depth estimate can respond by one range conversion. In addition, it means that the function lev 
(phase) in drawing 10 expresses the inverse function of the above-mentioned formula 15, and 
calculates the number of stages of the amount translation table of parallax from the amount phase of 
phases [pixel]. 
[0082] 

[Effect of the Invention] According to this invention, when changing depth estimate into the amount 
of parallax using distance scale conversion, distortion of an resolution picture can be pressed down. 



[Translation done.] 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the flow chart which shows the control procedure of the CID method which these 
people already developed. 

[Drawing 2] It is a mimetic diagram for explaining distortion oppression processing of step 3 of 
drawing 1 . 

[Drawing 3] It is the graph which shows the relation between the amount W of parallax, and its 
fusion location Yp. 

[Drawing 4] It is a graph for explaining perfect distance scale conversion. 

[Drawing 5] It is a graph for explaining polygonal-line distance scale conversion. 

[Drawing 6] Depth Yp and the amount W of parallax [pixel] Since it is nonlinear, before and behind 

a tubular surface, the value with the same depth estimate, "1", is a graph to show the property in 

which the amounts of parallax differ greatly. [ for example, ] 

[Drawing 7] It is the flow chart which shows the control procedure of the CID method by the gestalt 
of implementation of this invention. 

[Drawing 8] It is the flow chart which shows the distance scale conversion of step 13 of drawing 7 , 
and the detail of distortion oppression processing. 

[Drawing 9] By introducing the technique of distance ratio maintenance, even if a dynamic range 
changes, it is the graph which shows that the depth relation before and behind a tubular surface is 



[Drawing 10] It is the mimetic diagram showing the case where polygonal-line distance scale 
conversion of only quantitative ratio maintenance is performed, and the case where processing for 
distance ratio maintenance is performed further. 



[Translation done.] 



held. 



http ://www4. ipdl .ncipi . go jp/cgi-bin/tran_web_cgi_ejj e 



5/13/2005 



JP,2001-298753,A [DRAWINGS] 



Page 1 of 4 



* NOTICES * 



JPO and NCI PI are not responsible for any 
damages caused by -the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DRAWINGS 



rDrawing 11 
( start ) , 

B-Y.R-Y 
ffiftft 



5 



3 



mm**-* 



[Drawing 2] 




[Drawing 7] 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



5/13/2005 



JP,2001-298753,A [DRAWINGS] 



Page 2 of 4 



(start) 



B-Y,R-Y 



5 



, 1 2 



1 3 



_3_5 



BW MB« 

C END ) 



[Drawing 3] 


A ° 

* -4000 
Yp 

On] -6000 
-8000 
-10000 
•12000 












\ 






\ 







-65 -325 0 32J5 



[Drawing 4] 

Ml 
A 




[Drawing 5] 




http://www4.ipdl.ncipi.gojp/cgi-bin/txan_web_cgi___ejje 



5/13/2005 



JP,2001-298753,A [DRAWINGS] 



Page 3 of 4 



[Drawing 6] 



2000 

A 

n 0 

# -2DO0 
-4000 
M -6000 
-8000 



-12000 













I ==== fc 
























rm 

h 









ft 

!* 

IK 

L 



65 Jfc 
O30» 



rDrawing81 
(start) 



5 



front-Mfront 
rear=Mrear 



2 1 



2 2 



5 



front, rearlc 



2 3 



5 



2 6 



front £ rearOtttfi 
front, reartit€&£ 



2 4 



2 7, 




2 a 



front, rearttC0*2fefilS 



NO 



C END ) 



[Drawing 9] 





2000 




0 




-2000 








-4000 


Tp 




W "BOW 




-8000 



-12000 



-32J5 













-I ^ 










r 

II! 






-* 





323 



65 



* 

It 

se 
tt 
m 

* 

it 
C=30» 



[Drawing 10] 



http://www4.ipdl .ncipi .go .jp/cgi-bin/tran_web_cgi_ejj e 



5/13/2005 



JP,2001-298753,A [DRAWINGS] 
Ymax_N' -r - r ''fl^hase) < T 100 



- - Dlev <- 
Of o - -' 



70 (surface_depth) 



Ymin_N' J- — > - 1 - lev(Mrear) < - 1 - O 

■7—7JW 



depth 



Ymax^N' T -t- lev(Mfront) -r* 100 

- lev(front) 



--Dlev <- 



0 



lev(front) 



■ - 70 (surface_depth) 



Ymin_N , -L — > J- lev(Mrear) < L 0 



depth 



Ymax_N T -r- 



T lev(Mfront) _ ^ ^ - y 1 00 
lev{front)^""~ 



0-- 0-- 



D!ev <- 



- - 70 (surface_depth) 



--<-> --lev(rear)x^ 
Ymin^N' -L — > -L lev(Mrear) - 1 - 0 

de P th 



Page 4 of 4 



[Translation done.] 



http ://www4 . ipdl .ncipi. go jp/cgi-bin/tran_web_cgi_ejj e 



5/13/2005 




d9) nxmrnvf ( j p) (12) ^^Wr^^^ (a) UDttttfcbn&MS-f- 

#Pf!2001 -298753 

(P 2001-298753 A) 
(43) <&m 0 ¥^13^10^ 26 0 (2001. 10. 26) 



(51) Int. CI. 7 BSlJfB9- FI 7-73*4* 

H04N 13/00 H04N 13/00 5C061 



(21)ttHK#* 


#@12000- 109210 (P2000- 109210) 


(7D mmx 


000001889 










(22) am B 


^12^4^110 (2000.4.11) 












lut mm 






















<72)*W# 
























(74)^31 A 


100086391 



















(54) l&W<D&m 2»5Ei«ftSr3»c5E8«ft^**-f5*ife 



(57) [S£fo] 



(start) 



2 2 



1 



Afr**ft£ff 

2 1 



front-Mfront ^ 
rear-Mrear 



2 



front, rearC: 



2 3 



5 



2 6 



front ct rear<DJt# 
front, rear* 



2 4 



2 7, 




2 5 



front. rear{l0jS&8lft 



NO 



5 



( END ) 




( 2 



1 



|c, *V ?9 Ui^fcMjELfctL *BE*o^-J- 
ttfcjfci- <fc 5 K Lfc r t «r»« t -T5 »*« 1 fcSE*W> 30 

[0 00 1] 

[0 0 0 2] 

T> ciDffitv>5) SrUEKPBib-CV^ (#M¥ii 

- 8 8 6 2 *4iS*U 1 1-9 8 5 3 0 £-4*?8# 
BR) . 

[0 0 0 3] Sfc, *tt)PA«, BEfcWWBLfcC I D* 

[ 0 0 0 4 ] 121 1 12. &&^<75C I D}£ (^ft)-ei±4 

[0 00 5] *1\ -BffiSr**<7>««te^ta U 
03ffi#ta»feiS5JIigL ilKnyF^h, £(B-Y, R-Y /& 50 




#BB2 001-298753 



2 

[0006] ^»ffiflisKo^-aftBj-r3„ c i T>m 

-Ci±, 2DM{ft«rSE»L;fe&lHfc«:£|fc-*-.5 0 r»» 
^*#<*9i"^*i:^a«{/j:iWfti*«yt«>, CID 

T^*fc*feilfc£*imfc©S*fr«|6»i _su PP _le 
v[Pixel]6tTfc4SJ:?#J»U-CV>5. ■*-**> fc, jf5£ 
b /c JifT # £Mf ront £ Mrear t <D ffl (rfij (? 5 r i: 

<£>^&#£>5„ -<D^<D#^ii:Srh _dv_max [pixel }t 
b, h _dv_max /5S31^fr3?$SB!h _supp_lev [pixel] 
*&X-Z>m-&\*.. &5£l Sr«S£i-5*-CMfronti: Mrear 
£0 [pixel] troff^TS^fiK/J^-rs,, 

[0 0 0 7] 

[&1] 

h_flv_jnax £ h_supp _Jev 

[0 0 0 8] ttfoT, h _dv_max _supp_lev ± 

9*£v^§-£-W:, IH2W*{l!|ro|2H^-t-j; 5 ir, ^ifeife 
^cDfllt/aj UfclBifront [Pixel] ir&i: (JffittfireartP 
ixel] »CS:2C0S^jS*t-±9, ^.-If^^^fo 
fcft^flStfffi LfiffiiMfront [Pixel] <t***£ <9 ffitt 
flrMrear [Pixel] <t 9 ,]s£ < -f-£ o 

[0 0 0 9] 

l«Sc2] 

front <=M front* hjuppjev /h _jfv _jnax 

far h_dv_jnax > h _jupp_lev 
rear = Mrear * hjvppjev / h_dv _jnax 

far h_dv_jrtax > h_fuppjev 

[0010] h _dv_max /S^h _supp_lev J; <0 

ISI2coi{|!lw|2H-^-t-j; ftS3«!5±o„ 
[0011] 
[*3] 

front = Affront far h_dv_max £ h JUppJev 
rear —Mrear far h_dvjnax£hjupp_fev 

[0012] h _dv_max fch _supp_lev i 

dv_range(=front rear) =l— Vtf^lhfeibtLtilte 
0/'ftJS'i> U-^vfadv _range(=Mfront Mrear) t 

[0 0 13] 4fc\ H^li*3lt-5r<7)^^-$ i^y 

*h _su PP _iev ^mMvtzmff^^mm'W^m^x 




( 3 



[o o 1 4 j m&^-^mkism^^xvm-t^ 

[0 0 15] 2BSC4*f-f *:/W?W:» *IS^iii^ 
(RVMfc) ££8Rfli®& (LHtt) (O^fiJ^dSilW 

[0 0 16] -f4tot>» f^^TWflBJi-eftSfcWCHm] 
£ #o R ± V L EI& £ V 05 SEBt K [mm] Kftfc 

Yp[mm]l4^4T-^$iX-5. 10 
[0 0 17] 
[&4] 

fp<n kw/(w-2E) 

[00 1 8] ±mm^.4\zio^^X, #^!4JUTWffiSr 

K : ^^U^WffiA* T?©IEIB [mm] 
E : ISMW1/2 G9g£ [mm] 

JSSdSfi [mm] 

Yp : mmfr bM&tiLmti T-<£>gggf£[mm] 20 
[0019] K=1000mm, 2E=65mm t LT±fES5:^:4 Sri/ 

[0020] Ei3<fctK &?f%mj£m*mnm\-mm<n 

m-*^fc£8EHt*'Jr-/i^»£v*5. 30 
[0 0 2 1 ] EtT, S§if^^-/w^^^oVNTfffl* 

[0 0 2 2] 4", r^rKlro 1 iii^Wti&U[mm] 

[0 0 2 3] 
I«fc5 ] 

W=at/ 

[0 0 2 4] ±IS!gc^5Sr±fBift^4^A-t-3r it 
•t 9 x 6 5»c, EMf£§4{£te«roBS«;4s# 40 

[0 0 2 5] 
1*6] 

Yp = KaU/(aU-2E) 

[0 0 2 6] ±aS6Sr«»b2lt*7Sr»5. 

[0 0 2 7] 

[*7] 

a ~2E* Yp/{(Yp - K)U} 

[0 0 2 8] 5o±mffiX*—;^mT'\L *ffi*»P>«)* 
^CfRt5fcB LiYmax' t fii>?>©S^4 t> JIYmin' Sr 50 




2001-298753 



4 

^■rst, Hfx#jt^<Sdepth (o~ i o otDm&w 

[0 0 2 9] 
[*8] 

Kp^fTmax'-ymfn' )x depth/ 100 

[0 0 3 0] ^rb-C, Yp^»ffii-5aS6*att, ±IE7 

[00 3 1] ^fEK^4r— /idClftfcJBV^-r. 2 5 6g 
£51-, *1\ Ymax' ~Ymin' «0 f?fl £ 2 5 6 ^ U =g- 

&n$mpmzttm bfc&gfi^&^-y/vr * [pixel] 

[0 0 3 2] C<7?#^\ W"[255] tfYmax \ZftfcV1t.W. 

W*[0] j^Ymin* C^JESLfc^fiir^S. 

[0 0 3 3] 

[«9] 

[0 0 3 4] lev ttfttM«f-^±oa 

&£^U &5£l 0t?^^t>ix3 o 
[0 0 3 5] 

[ffcio] 

Uv = 255 x depth/ 100 

[0 0 3 6] rr*T% 2D/3D^mtr*3(t^^Sg 

[00 3 7] (1) *tT*Yp*J«Bfti-50f*-e**JRV 
fflL,»Ymax' Ymax' )Ste<9*tT#ffi£r 

[0 0 3 8] (2) JMrSffSgSlBO^V-f-S j/^ 
v J ?r^:#<St^>5 ir-TS !3 SYmin' «r/Jx§ 

[00 3 9] JbfEroBg®SrlH]]Ki-3fcii>(rti, t 

[0 0 4 0] ^rr-c\ afSSUfeWdSftKUB^i-SWix* 
Ymax'~0 §r255*C/100 ^^b, 0 -Ymin' Sr255 {(1- 

o/ioo)} ^-t-s-ir-e, umm^^-y/^^tb 
3„ 

[oo4i] -t-jfcfet,. j«vta Lfijtc zmw-fz z. t 



( 4 ) 



15> = rmax'xf depth - (700 -C)f/C 



®M 2001-298753 
6 

[004 2] 

[am 

for depth S; (100-C) 



Yp={-Tmbt'xdepth/(100-C)l +Ymin' for depth < C 

[004 3] SiiSif-^r ^g^cSr« [0044] 

1-±IES;i 0fc»J6-f-5*J4, **1 2 [f 12] 

fcv=r255-ZJfev; x{depth -(100 -C)}/C+Diev for depth & (100 -C) 

for depth < (100-C) 



lev=DUvxdepth/(100-C) 

[0045] ::t% Dievia. 3-cj£*sn, g 

[0 0 4 6] 
[mi 3] 

DUv =(100-0x255/ 100 

[0047] gfoiMEiB* <5r-;^m±wm a v «ti t , 

^nBftft^T^^^SjSp. J k\^r>&<<r>Wfc£frt>& 20 

< * 5 t v » 5 <5tft fc*<5v » 5 0 
[0 0 4 8] ^IcftffiLtl^llfi, ffffiW^ 

pYmax', Ymin'.C £r*^L-C1^5 0 
[0 0 4 9] tr^f, ±»Lfc*HB«*«:fl!V*fciE* 

14, @ 6 K^-f-J; 5 fc, EH**— A**-*?!*, JWr# 
Ypttl^SW [pixel] 9, **T£#t5i&S 30 

fcittf" 1" -et*BoiMr«T?i4-troas 

[0 0 5 0] b^U, «tffflL*JfcC«r*d»*Tt&**r*i. 
dv_max [pixel ] £r?l#-ff ^f&fflh _supp lev [pixel] ft 

[00 5 1] 

Sr 3 *5Etttf»csC*i-5*ffiSr»«^s r. t £ B«J£f 
[0 0 5 2] 50 



ofir^(7)ft^:{jtSr**65^3X^y^ 
^teffll*3T-fcS^ ; g : ^Sr*J^i-5m4^.7 i s/V > ftf>tf 

U #&S#ffiM«fefciKw ft 
3 ^ 7- y -y\zWfi-$-Z> % 5 7*7- v y*ffiz_X\, ^ r £ Sr 

[0 0 5 3] ilE^S^-r-j/^trfeV-C, ^Lfc^-f 

[0 0 5 4] 

i&mnmtt&oi&m sit. &7~mi o&&mvx, 
[0055] 1171^ z<Dmm<omm.<Dmm\-i.hc i 

[0 0 5 6] *-f, -WEfc*#aMS«K:*MHU 
«)««*»bi«J«*, »A=>>h^^F, fe(B-Y. R-Y fig 
#> C0lt^Sr»S (^^s/^1 1) . -t bTs 




( 5 ) 



2001—298753 



[0 0 5 7] 0 8(1, 07^f^^l 3 0Eggf^>^- 

[0 0 5 8] £1*, Mfront^Mrear 

8H£tB*S:»5 (^x^^ , 2 1 > 2 2) 0 »fenfc(R<^ 

_dv_max [pixel] (^77^2 3) 0 

[0 0 5 9] ffl$m®m<DGLftm(Dm*:m _dv_max 
[pixel] tfSS^WF^ftHh _supp_lev [pixel] T*$>5 

3^2 7) 0 

[00 6 0] BtMttn^ttftM^**tt^S»ffFff« 
H^"C*>5»&Jc:H:, £0H&fe^**tt*4i _su PP _ 
lev KTIwft5*-C, MfrontirMrear tioTS^^n 

"C*a*front , rear|fiSr»S Ury7'2 5) 0 E* 

[0 0 6 1] ^gg^&a^J:o"C**?tfront irrear 
£<£>Sg|§iJ£§:, a— yWJtoEBJtteftSJ: 5, front 
<fcrear££r^3EL*:^ Ufy/2 6) , ^TyZf22 



8 



*aaSr, WWE««Hl^ffi««^**flJh _dv_jnax[pixe 
l]d^*ffgJ6Hh _supp_lev [pixel] rtfc45$-C 
»9igU *»«j*B«ffi*B**»5 0 4*5, 

[0063] s#«*tesfco^-cK0i-t-s. 
io [oo6 4] *tf#«i««[iffiffi*i:*s*»»-e*sE 

fH*^-^"?!*, front fcreaH([-e*JE4tt«^-Y-^5 
[0 0 6 5] 3Sifcfll*«ia^*5l^T, «S6**>£att. 

m\<^fcJj :©JSi;o^r, o — 100 

Hff #J£SffiS:surface _depth(= 100- C) £ LT, tft 

20 9h-5 d 

[0 0 6 6] front It&rearlKKlM^SaSMIIlT- 
— ±<7>&»&^n^ftMax_lev (=255~~Dle 

v) , Min _lev (=Dlev — 0 ) fc fc5^tT 
#}f^{4v __depth <D&M&&& : ? — 7/l'<Dfk$klev 

[0 0 6 7] 
[«1 4] 



[00 6 2] ^7^/2 2, 2 3, 24, 2 5, 2 6 CO 

Uv=(v_depth - $itrface_depth)* (Maxjev - Dlev)/ (100 - surfdce_depth) + Dlev 

for v_depth > surface _deptfi 
lev =(v_jepth - Minjev )* (Dlev - 0) / ( surface _aepth - Minjev) 

for v_depth < surface _depth 

lev = Dlev fi,r vjkpth « surface _depth 



[006 8] lev fr#JS-r*ffi« Sphase {1, {^f^ 
^7-^W fc± 9— ^i 5ti 

[0 0 6 9] 
Hftl 5] 

[00 7 0] S&ttSM&STNl, »»««BBC0ffi*BM(7? 
**£45 2o<Offi«Ofi:ftM^5h_supp_lev JKTfc 
4 5 front fflCirrearfflS:, Max _lev -^Min _lev 

[0 0 7 1 ] ±i£5£i 4**feWba*4J: 5ic XfttRX 

a s J*ottft*©H«K:j£l^ ft3g/^front fit £ rearffi<D 
a?»*fttt£tT^ 3 WH * « 5 0 

[0 0 7 2] mi * : W««a*#U:*fl5 J: 9 WOffl: 
*SaSr«po4&^tt, front ffiSrO Jriff<5^TfT< (Max 50 



_lev fcDlev»CiE<»tTl*<) o 

[00 7 3] f 2 : Wg«^*Hfffi J; 9 

fifcffifiSr^O^^, rearffi£0K5£-3ttT?T< (Min 
_lev SrDlev^iff^itTV^O 0 

[00 74] ^3 >Jr-* : — ;&OM£* s *SE J: 9 SlJOffi 

t?o»^ tt % front, rearffl[S:#»c: 0 fciff-SW-Tfr < (Max 
_lev,Min_lev SrDlevlCiS-StfTl > <) 0 

[0075] $3^^i;it m&m&tmm 

*9**1 6(^l8ffiS:{*l$i-5 J: 5tw, Max __lev <tMi 
n __lev SrDlev^i5<5(t"CV^< 0 

[0 0 7 6] 

[*1 6] 

(255 -Dlev): Dlev = (Maxjev- Dlev) : (DUv - Mbijev) 

[0 0 7 7] ±|BS:i 6IL 08^75/^2 6^1 




-f0 8 (O *7-y -f 2 6T*fr5, 
[0 0 7 8J KBt*^— vHr*JV>"Cr<DiEg|i|Jtiai«FO# 

ffifi£2 0%«/>$-£fc#£-irii N WSJ: 

[0079] nm&£mT-7;u±-e~<wg.M}tmwz 

'not, «tfUL**c©H«fc«»-f* 
[0 0 8 0] L*»U ««#©B«)4W4Ki±o-CM[» £ 

[0081] in 1 0 (4, &itmwco^.comrim?s.m^^ 

# 5 0 /«£ *5, 0 1 0 K *S 3 B33&lev (phase) |4± 
125*51 5<0igH?R:|r*U fitaSphase [pixel ]*» b«M . 

[008 2] 




#M 2001-298753 



10 

[«flJ»MJ rcD^BJtritLll, IBS**— A*** 

fc<D5*&WS 3 J: 5 

[0ffio«!¥^»iK] 

[0 1 ] #ffiKA#gEKMS§LfcC I D&cofijffll^as^ 

[0 2] 01©*^y^3O£*»ffi^fcR9lir-;5fc 

[03] »3l*Wi:-to?iSMWi«ypi:©H«Sr^^7 
10 77?$>3 0 

[0 4] ^^at^^-^*SrttWf-5fc«><0^9 7 

lias] mtimmmxtr— ^teztum-rzizuxo? 1 ? 

[06] *fr#Yp£a2i*r [pixel] 5 

[07] r<o^0J<7?HJi(O^ISJrJ;2,c I Difctf>fW^# 
20 JH&rTK-f-^n— N-e*j5 0 

[0 8] @7CXfy7'l 3<£>8£!t;*.'7-— ^^fc-fct* 

[09] emitmnto^m^mKirizkizi:*). *v 
[010] AMmn<D3j.<n$xfrm.vm* /He*&tr 



1] 



B-Y.R-Y 



3 



3 



r 



[02] 



F 



Mfrront- 





[07] 



(start) 



B-Y r R-Y 
■tiftffc 



1 2 



3 



1 3 



4. 




#Hi? 2001-298753 



[03] 



[0 4] 



2000 

A ° 

0 -2000 
* -4000 

rp 

CM -8000 



-10000 




[06] 




* -2000 





' * 


















\ 



















r* 

li 


-* 


d 




35 


-32£ 0 32j5 
«Utft* [-J 

===== His =■ - * 


08 



A 

ft 

}* 
ft 

* 

m 

m 

L 



[08 ] 



[09] 



2 2 



(start} 



front =Mfront 
rear-Mrear 



2 



front, reartc 



2 3 



5 



2 6 



2 4 




fronts reartD it & 
front, rear««ftSE 



2 5 



front, rearftOK&SESB 



NO 



( ENP ) 





2000 


A 


0 


ff 


-2000 




-4000 






M 


-0000 




-8000 




10000 




12000 







— ^ 

i — 




_ L 





















A 

100 

70 

m 

A 

ti 

J* 

ai 
o L 



323 



( 8 ) 



2001-298753 



1 0] 



Ymax_N' t- — ■> -p lev(phase) < -i- 100 



--Dlev <- 
0 4- 0 - - 



- - 70 (surface_depth) 



Ymin_N' -L --> -L lev(Mrear) < J- 0 

7-—7JUW" depth 



o 



Ymax_N' -r 



-r 7- lev(Mfront) _ - - -r- 1 00 

- <-> --lev(front) Xr~~" 



0 



--Dlev <- 



- - 70 (surtace_depth) 



Ymin_N' J- — > -L lev(Nlrear) < J- 0 

T-7)\>Vr depth 



o 



Ymax_N' -p j- lev(Mfront) 

<-> -- lev(front)^ 



0 0 



Dlev <- 



— - 70 (surface_depth) 



-- - - lev(rear) 

Ymin_N' -L L j ev (Mrear) 0 

t-7)W de P th 



( 9 ) 



#9i2 001-298753 



(72)^gpj# m 

^K^^mmzff bt i # i •§• E-wm^-n 

F* — 5C061 AA20 AA21 AB08 



